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Abstract — This paper addresses rate control for transmission 
of scalable video streams via Network Utility Maximization 
(NUM) formulation. Due to stringent QoS requirements of video 
streams and specific characterization of utility experienced by 
end-users, one has to solve nonconvex and even nonsmooth 
NUM formulation for such streams, where dual methods often 
prove incompetent. Convexification plays an important role in this 
work as it permits the use of existing dual methods to solve an 
approximate to the NUM problem iteratively and distributively. 
Hence, to tackle the nonsmoothness and nonconvexity, we aim 
at reformulating the NUM problem through approximation and 
transformation of the ideal discretely adaptive utility function 
for scalable video streams. The reformulated problem is shown 
to be a D.C. (Difference of Convex) problem. We leveraged 
Sequential Convex Programming (SCP) approach to replace the 
nonconvex D.C. problem by a sequence of convex problems that 
aim to approximate the original D.C. problem. We then solve 
each convex problem produced by SCP approach using existing 
dual methods. This procedure is the essence of two distributed 
iterative rate control algorithms proposed in this paper, for which 
one can show the convergence to a locally optimal point of the 
nonconvex D.C. problem and equivalently to a locally optimal 
point of an approximate to the original nonconvex problem. 
Our experimental results show that the proposed rate control 
algorithms converge with tractable convergence behavior. 

Index Terms — Video Transmission, Rate Control, Scalable 
Video Coding (SVC), Network Utility Maximization, Difference of 
Convex (D.C.) Program, Sequential Convex Programming (SCP), 
Nonconvex Optimization, Iterative Algorithm 



I. Introduction 

Over the past decade, there has been a rapidly increasing 
interest in multimedia applications in networking paradigms. 
Video-based applications such as live-streaming and video 
conferencing are in possession of the dominant share of such 
applications. Due to necessity of stringent QoS requirements, 
video transmission proves quite challenging. Throughput vari- 
ation that often occurs in both wired and wireless networks 
even exacerbates the problem. While this phenomenon is an 
inherent property of wireless networks that occurs due to 
fading and shadowing, wired networks also experience it as 
a result of network congestion Q], |2j. 
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Video adaptation schemes have been proposed to evince 
efficient means, not only for rate control to combat against 
throughput variations, but also to tune video quality to terminal 
capability and user preference on a per-user basis (3). As one 
of the most efficient video adaptation schemes, Scalable Video 
Coding (SVC) scheme allows for encoding a high-quality 
video bitstream that contains one or more valid and decodable 
subset bitstreams Q, (5). As an extension to H.264/AVC 
standard, SVC remedies challenges in video transmission 
through temporal, spatial, and quality (PSNR) scalability of the 
video stream, resulting in exhibition of several quality classes. 

To date rate allocation for video streaming over wired 
and wireless networks has been studied extensively [6|-|15|. 
Following the seminal works on rate control for elastic traffic 
| fl6l , fP7] , there have been several works related to rate 
control and resource allocation for video transmission in the 
context of Network Utility Maximization (NUM) frameworks 
that have considered resource allocation in both wired and 
wireless networks under different conditions (e.g. fi'8 1 and the 
references therein). The majority of such studies focused on 
elastic flows whose utility function is known to be continuous 
and strictly concave. Such an assumption makes the rate 
control problem convex and thereby tractable for achieving 
globally optimal solution thanks to dual methods flT) , fl8) . 

On the other hand, stringent QoS requirements of video 
streams makes them inelastic flow, whose behavior are char- 
acterized by nonconcave and often discontinuous utility func- 



tions 1 19 1, |20) . This characterization usually eventuates in 
nonsmooth and nonconvex optimization problems, which are 
difficult to solve in general through dual methods. There 
exist several works focusing on rate allocation for such 
inelastic flows under different scenarios |21|-|28|. In most 
developments thus far achieved to handle NUM problems, 
dual methods have played an important role as a consequence 
of convexity. To benefit from the developments originally 
proposed for elastic flows, many researchers aimed to con- 
vexify the NUM problem or to approximate it by a convex 
problem. Towards this, in most cases researchers aimed at 
redefining the notion of the utility or objective so that it 
yields a convex reformulation; in some cases, however, the 
transformed problem is not equivalent to the original problem. 

In SVC streams like other multimedia applications featuring 
layered encoding schemes, user satisfaction can be considered 
as having distinct utility levels representing quality indices. 
This corresponds to the notion of "discretely adaptive" utility 
function for each layer, whose extension yields a staircase 
utility function for SVC streams, as shown in Fig. 1 in solid 
line m, G9). 
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Fig. 1. Staircase utility model for Bus sequence and its Multimodal Sigmoid 
Approximation 



In a previous study |26|, we proposed an analytical model 
for utility function of SVC-encoded video streams through 
approximating the ideal staircase utility function to tackle 
nonsmoothness problem. This approximation was called Mul- 
timodal Sigmoid Approximation. Then we redefined approx- 
imated utility function through utility-proportionally fairness 
metric which yielded a convex NUM problem. Although the 
redefinition of utility function in this way was led to a convex 
formulation, the redefined problem is not equivalent to the 
original NUM problem. 

Under the above assumption, we believe that this paper 
makes the following contributions. 

• We extend the utility model for SVC streams proposed 
in (26) such that one can embed Quality-of-Experience 
(QoE) of the end-user into the notion of utility function. 
Towards this, QoE indicators can be included as input 
parameters to yield a QoE-aware rate control scheme for 
SVC streaming. This way, the staircase utility function 
will possess two degrees of freedom to control prefer- 
ences of users: rates and QoE indicators. 

• As a follow-on work to our previous study p0| , another 
contribution of this work is to approximate the NUM- 
based rate control for SVC streams by a D.C. (Difference 
of Convex) problem pTJ. In later sections, using a 
transformation, we manipulate an approximation of the 
nonconcave objective function to obtain a strictly concave 
objective function. These manipulations, however, trans- 
form the linear capacity constraints of the original NUM 
problem into nonconvex ones. Indeed, as we will discuss 
in details, the transformed capacity constraints admit the 
notion of a D.C. function. Thus, we achieve a D.C. 
problem which comprises a strictly concave objective and 
D.C. constraints. While our analysis here is more rigorous 
than that of [30) , our developments in this study go 
further still, where we give sufficient conditions for utility 



function characterization in terms of QoE indicators to 
yield strict concavity. 
• In order to tackle the aforementioned nonconvex D.C. 
problem, we leverage Sequential Convex Programming 
(SCP) approach (see e.g., (32), (33)). Using SCP ap- 
proach, one can replace the nonconvex D.C. problem 
by a sequence of convex programs that try to succes- 
sively approximate the D.C. problem. Strict concavity of 
the objective of our D.C. problem guarantees the strict 
convexity of the aforementioned (approximating) convex 
programs. This allows us to achieve globally optimal 
solution of each convex program through solving its dual 
with gradient projection method [34|. This procedure is 
the sketch of two rate control algorithms to be discussed 
in further details in subsequent sections. Under mild 
conditions on the starting point of the algorithms and 
some parameters, convergence to a KKT point of the 
D.C. problem is guaranteed. Indeed such a point might 
be a locally-optimal point of the D.C. problem^ which 
is quasi-optimal to the original NUIvj^] 
Finally, extensive simulation experiments allow us to reach 
conclusions regarding the efficacy of the proposed rate control 
algorithms for SVC streams. 

The rest of the paper is structured as follows. Section 
Ull reviews some related works. Section [Til] describes the 
network model and utility function approximation. Section 
IV is devoted to formulate the underlying NUM problem 
and its reformulation and approximation as a nonconvex D.C. 
convex problem. It also describes SCP approach to deal with 
D.C. problem. Section [V] investigates the optimal solution to 
the NUM problem. Section [VI] presents distributed iterative 
algorithms for the rate control of SVC streams. Simulation 



results are given in Section VII We conclude the paper in 
Section |Vni] 

II. Related Work 

As already mentioned, within the NUM framework, there 
have been a lot of prior works that propose several protocols 
and algorithms under different types of traffics, assumptions, 
and constraints (see [18| and the references therein). In partic- 
ular, some of existing research on NUM focus on the inelastic 
traffic [21 1-|25|, that correspond to rate-adaptive transmission 



scenarios, such as video streaming |20|. The inelasticity will 



affect the utility function and turns the utility maximization 
problem into a nonconvex one. Some inelastic flows (e.g. some 
types of video streams) have been modeled by sigmoid-like 
utility functions (20) . We note, however, that such functions 
cannot capture the characteristics of SVC streams. 

In our work, the main focus will be on NUM-based rate 
allocation in SVC transmission scenarios, where the utility 
function is staircase function. By employing staircase utilities, 

'Note that the complexity of D.C. problems is NP-hard. It should be noted 
that the convergence time using centralized methods such as branch and bound 
(with non-polynomial time complexity guarantee) can be quite long even for 
problems with relatively small size 1311. 

2 Since we devise rate allocation by solving an approximated version of the 
network utility in lieu of the original NUM, we refer to this development as 
quasi-optimal solution to the original NUM problem. 
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it is possible to take into account both video characteristics 
and preferences of users as QoE indicators in rate allocation. 

In pT) , the authors adopted sigmoid utility functions and 
proposed a distributed admission control approach for such 
utilities, called "self-regulating" heuristic. Although the pro- 
posed method in |2"T) can be extended for our approximated 
utility model, but rate allocation in our solution will employ no 
heuristics for preventing divergence of the algorithm. Hande et 
al. in 1 22 1 investigated the optimality conditions for distributed 
iterative dual-based algorithm to converge to globally optimal 
point despite using nonconcave utility functions. Although 
deriving the sufficient and necessary conditions for such a 
nonconvex problem is valuable, this work does not pragmati- 
cally solve the inelastic rate allocation problem. Sehati et al. 
in J23) , addressed rate allocation using the NUM framework 
for streaming traffic whose characteristic can be captured 
by a specific sigmoidal-like utility function called S -curve 
function. They employed Sequential Convex Programming 
approach to devise a distributed rate control algorithm as 
a sub-optimal solution to the nonconvex NUM problem. In 
p5) , through Utility-proportional fairness metric, a modified 
version of utility function is introduced that is appropriate 
for heterogeneous networks carrying both elastic and inelastic 
flows. 

In J27) and [28], using particle swarm optimization (PSO) 
p5j , the authors proposed two solutions for maximizing 
network utility of both elastic and inelastic flows. PSO is 
an evolutionary algorithm that can be used for discontinuous, 
non-convex and nonlinear problems such as ours. But, the 
main problem is that this algorithm is centralized and is 
not desirable in networking scenarios. In addition, due to 
randomized nature of this algorithm, convergence cannot be 
guaranteed. 

Some research studies adopted the rate-distortion function 
as the utility function for rate control of SVC streams |8")-fT3). 
The authors of [ 1 1 1 chose PSNR function as utility function 
and proposed a distributed approach for resource allocation in 
video streaming scenarios. In [8], a content-aware distortion- 
fair networking framework with joint video source adapta- 
tion and network resource allocation is developed. The main 
difference between these works with ours is that employing 
distortion or PSNR as objective function captures the content 
characteristics of video transmission, while staircase utility 
function is more general and captures the traffic characteristics 
as well as preferences of users in SVC streaming scenarios. 

A. Quality of Experience 

In this subsection we review some facts about Quality 
of Experience (QoE). QoE is defined in [36] as "a multi- 
dimensional construct of perceptions and behaviors of a user, 
which represents his/her emotional, cognitive, and behavioral 
responses, both subjective and objective, while using a sys- 
tem". While traditional well-established notions of Quality of 
Service (QoS) are considered as network-related metrics in 
terms of bandwidth, delay, jitter, and packet loss, QoE is a 
user-related metric. In the case of multimedia streaming, from 
user's point of view, QoS indicators are not sufficient to get 



an accurate idea about the final acceptability of the received 
content. On the other hand, the main focus of QoE is on 
the overall experience of user. Thus, some recent studies put 
effort on replacement of QoS by QoE, since the latter is more 
correlated to the user's preferences. 

In our NUM framework, input parameters of the problem 
(staircase function parameters) can be interpreted as QoE 
indicators of users. In particular, the underlying staircase 
utility function we consider is QoE-aware. As two parameters 
that define the staircase utility, rate points and quality indices 
can capture user's preferences in terms of QoE indicators. We 
defer more discussions to Section IIII-BI 

III. System Model 

A. Network Model 

We consider a network comprising a set of sources denoted 
by S = {1, . . . , S} that share a set of logical links denoted 
by C = {1, ... , L}. We denote by c = [ci,l G C) the link 
capacity vector where c/ is the capacity of link I in bps. Let 
x s £ X s — [m s ,M s ] be the rate of source s in bps and m s 
and M s be the minimum and the maximum rate of source 
s, respectively. Also let X — <&f =1 X s denote the Cartesian 
product of X s , s = 1, . . . , S. 

We assume that each logical source transmits one video 
session and thus we will use terms 'session' and 'source', 
interchangeably. We focus on static routing and to represent 
the links that source s passes through, we define the routing 
matrix as R = [Ri s ]lxS^ where i?; s is defined as 

J 1 if session s passes through link I 

Kls = \ otherwise " ( ' 

In order to simplify the analysis and not relying on any 
particular packet scheduling and flow control scheme, rate 
control is ideally accommodated by congestion in links. Thus, 
a rate allocation vector x = (x s , s G S) is feasible if and only 
if x E X and flow of each link is less than its capacity, i.e. 

s 

RisX s < q; I e C. 

s = l 

Formally speaking, we define the feasible rate region T> as 
the following polyhedron 

T> = {x e X\Rx < c} . (2) 

B. Utility Model 

We suppose that source s, when submitting its video session 
at rate x s , attains a utility U s (x s ) which captures the level of 
quality perceived by user. In this paper, we assume that video 
session s is encoded in compliance with SVC standard and 
this subsection is devoted to model the utility function for 
SVC-encoded streams. 

For video sequences encoded in compliance with SVC 
standard, rate allocation is ideally limited to distinct levels of 
quality. This means that the utility function is increased only 
when a higher layer can be delivered due to increase in the 
available bandwidth. Thus, the ideal utility function for such 
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sequences is characterized using a staircase function, which 
is shown for Bus sequence in Fig. 1 in solid line. 

As discussed in Section |IJ for rate-adaptive multimedia 
streams, NUM problems are usually nonconvex and nons- 
mooth. In particular, for SVC streams whose ideal utility 
function is staircase function, both nonconvexity and nons- 
moothness issues exist. In our previous studies J26) , |30|, 
we proposed a smoothed approximation of the ideal utility 
function for SVC streams, referred to as multimodal sigmoid 
approximation. This approximation is shown in Fig. 1 in 
dashed line. In this study, we consider a more accurate utility 
function as the approximation to staircase utility function that 
takes into account a more general quality model for different 
layers. 

In what follows, we briefly describe the construction of 
utility approximation. We consider the ideal staircase utility 
function U ldcal (x) in general form defined by a quality index 
sequence {ui}i=o : ...,N and a rate index sequence {ft}i=o,...,jv 
such that 

U idca \x) =u i+1 ; igOSi.^], » = 0,...,JV-1 (3) 

Rate points in utility function reflect the layer changing 
points and thus are defined on a per sequence basis. Hence, for 
each video sequence we would have a specific utility function. 
Therefore, rate allocation will be influenced by users' QoE as a 
result of having different video sequences. On the other hand, 
according to (37}, QoE is defined as the overall acceptability of 
received content. Beside visual quality of the content, as one 
indicator for acceptability judgment, some other parameters 
have also influence on QoE. One such parameter is the type 
of receiving platform of the end user. Here we do not restrict 
the rate allocation to any specific receiving platform. As such, 
users can be considered as having different priorities for video 
resolutions. While higher resolutions (i.e. higher spatial layers) 
are completely satisfactory for users with high resolution 
screens, it is not appropriate for those with handheld devices. 
Thus, different levels of utility function at each rate point 
(defined using quality index sequence) can vary based on the 
end user's receiving platform. 

C. Utility Approximation 

Let U(x), x £ X denote the smoothed utility function. 
We assume that the zth transition in U(x), i.e. transition 
of utility function from quality index m to Uj+i, occurs 
at rate index x = ft. We refer to this transition as the 
ith step. Thus, we divide the domain X into TV intervals 
Xo,Xi, . . . ,Zjv_i with non-overlapping interior^] such that 
ft £ int — 0, . . . , N — 1. Focusing on two contiguous 
steps, say i and i + we define the lower and upper boundary 
points of Xi to be the middle points of [ft_i, ft] and [ft, ft+i] 
intervals, respectively. Now we can write 

Aft +1 



1i = 



where 



ft-^,ft 



Aft 4 ft - ft_! 



(4) 



Then, the underlying idea is to define U(x) as a smoothed 
version of U ldoal (x) by N properly defined sigmoid functions. 
Towards this, for x £ Zj we define U(x) as follows 



U(x) = (ui+i - Ui) F(x, a, ft) + Ui 



x£l l (5) 



where F(x, a, ft) is the sigmoid function with parameters 
(a, ft) and is given by 

1 



a, ft) = 



(6) 



1 -f e -a(x-Pi) 

It's easy to show that x — ft is the inflection point of 
the sigmoid function, and given ft, a determines how good 
the sigmoid function approximates the step curve. Then, the 
approximated utility U (x) can be expressed by 

(ill - u )F{x, a, ft) + u x£l 



U(x) 



(u i+ i - Ui) F(x, a, ft) + Ui 



x £ Xi 



^ (u N -v, N -i)F(x,a,@ N -i) +Wjv-i x£l N _ x 

(7) 

Continuity of U(x) is relying on the choice of sigmoid 
parameters a and {ft}j=o,... at- If they are chosen such 
that Gi = exp (^ct^^j , i = 1, . . . , N are sufficiently large, 
the discontinuity gap between contiguous sigmoids vanishes, 
thus making U (x) continuous and differentiable, as shown in 
Fig. 1. 

In this paper, we assume that session s has N s layers. 
Then, representing its quality index sequence and rate index 

sequence, respectively by {//.,], v and {ftj}i= ,...,iv». 

we express utility function U s (x s ) for video session s by 

U s (x s ) = U(x s ,a s ,{M) (8) 

IV. Problem Formulation and Approximation 

We model the rate control algorithm for SVC-encoded 
streams as the solution to a NUM problem. The objective of 
such a NUM problem is the aggregate utility of all sources. 
Nondifferentiability of the ideal utility function can be reme- 
died by employing the multimodal sigmoid approximation 
introduced above. Therefore, we consider the following NUM 
problem 



max ) w s U s (x s ) 

x£T> ^ 



(9) 



s£S 



where w s ,s = 1, ...,S are normalized positive weights 
such that ^2 s w s = 1. Problem ^ is nonconvex because of 
nonconcavity of U s . 

A. Objective Function Approximation 

In order to come up with a more amenable formulation, we 
consider the following optimization problem 



max y^w s \ogU s (x s ). 
x ses 



(10) 



We denote by int Z the interior of set Z. 



The following lemma states that problem (10 1 approximates 
problem d9l. 
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Lemma 1: The optimal solution of problem ([T0| gives a 
lower bound to the optimal solution of problem (|9|7 

Proof: Taking the logarithm of the objective of |9]l yields 



maxlog y w s U s (x s ) 



(11) 



Since log(.) function is monotonically increasing, maximizing 
is equivalent to maximizing (9), and thereby problems 
and are equivalent (381. On the other hand, log(.) is 



(11 



(11 



a concave function; hence for z s > 0, s G S, we have 

l w s logz s (12) 



log (^2 WsZs ^j - ' 



provided that w s > and J2 S w s = 1- Then, provided that 
U s (x s ) > 0, using ( fl2| i we get 

log ^w s C/ s (x s )j >^w s log[/ s (a; s ) (13) 

This tells us that the R.H.S of ( fT3] l is the lower bound of the 
objective of ( 1 1 1. As (fT3]l holds for all feasible points x E T>, 



at the optimal point, (TTTJ is lower bounded by (10 1. Finally, 
equivalence of (|9]l and (|ll|i completes the proof. 



It's straightforward to confirm that the objective of (10 1 is 



nonconcave. In order to come up with a concave objective, we 
use the following transformation 

x s = e a ° x ° (14) 

Substituting x s = — logx s , we reformulate the new objective 
as 

U s (x s ) = \ogU s {x s ) 



log U„ ( — log x. 



e * s 4 [, 



Concentrating on the ith interval, by further simplifying the 
above we get 

1 



U s (x s ) = logU, 

= log 

= log 

= log 



lOB 



1 



Ah s (, + i)F — \ogx s ,a s ,p s 



Au 



«(»+!) 



1 _|_ g- Q =(s7 log£ s -0 si ) 



(i+l)2<s 



x s G x s 



where I si is the image of X si under mapping (14i. The 



following lemma determines the conditions under which the 
transformed utility function U s (x s ) is strictly concave over 

x s e X s . 

Lemma 2: Provided that the quality index sequence 
{Mi}i=o....,A r is monotonically increasing and strictly concav^] 
and Gi's are sufficiently large, i.e. 

4 A sequence {a;}i— q ... n is said to be concave if the inequality 
a,i > (ai_i + Oj-|-i) /2 holds for every aj, i = 2, . . . , N — 1. This sequence 
is said to be strictly concave if the inequality holds strictly. 



CI: zii+i > Ui\ i = 1, . . . , N — 1 
C2: m+i - ih > Ui + 2 - Ui + i\ i=l, 
C3: Gi = exp (a^f) > 1; i = 1, . . 

then the transformed utility function U (x) is strictly concave. 
Proof: See Appendix I. ■ 



.,N-2 

, N 



We reformulate problem ( 10 1 by substituting transformed 
utility functions as 



max}^w s U s (x s ) 



(16) 



where x = (x s ,seS) represents the transformed rate vector 
and T> is the feasible region of the transformed problem which 
is defined by 



D 



x G X 



Ris 



logi s < Q,l G C 



(17) 



where X = <8>s—iX s . Problems (|10| and (116) are equivalent 



as (14 1 is monotonically increasing and its domain covers T> 



B. Sequential Convex Programming (SCP) Approach 

Unfortunately the feasible region of the transformed prob- 
lem T> is a nonconvex set. To show this, we consider T> as 
the intersection of 0-sublevel set^] of L functions defined by 

mix) = V — logi s - q; I G C 

The 0-sublevel set of <?;(.) is convex if and only if gi{.) 
is quasiconvex. The function logi s is quasiconvex, how- 
ever, a positively weighted sum of quasiconvex functions is 
not necessarily quasiconvex p8) . Indeed, simple algebraic 
operations can show the failure of quasiconvexity of gi{.). 
Therefore, gi(.) is not a quasiconvex function and thereby 
T> is nonconvex. Nonconvexity of T> makes problem (16 1 



nonconvex, too. We note that gi(.) can be written as the 
difference of — q and — ^ s w s log x s , i.e. as the difference of 
two convex functions. Thus it is a Difference of Convex (D.C.) 
function [31]. In particular, in this specific case where gi(.) is 
a concave function, the constraint gi(x) < is also referred 
to as a reverse-convex constraint as gi(x) > corresponds 
to a convex constraint. Reverse-convex constraints are special 
cases of Difference of Convex (D.C.) constraints [ |31| . 

In order to tackle such D.C. constraints above, we use the 
Sequential Convex Programming (SCP) approach (see e.g. 
(15) 1 23 1, p2), (33)). In SCP approach the original nonconvex 



problem is approximated by a series of convex problems, 
where each convex problem is constructed as an approximate 
to the nonconvex problem in a feasible point. Since noncon- 
vexity of our problem is due to nonconvexity of reverse-convex 
constraints, employing SCP approach for that is equivalent 
to approximating them by a set of convexified constraints 
successively. This has also been referred to as Successive 
Approximation Technique in some recent works, e.g. [39|. 



5 For a function / : R n — > R, the associated a-sublevel set is a 
subset of the domain whose elements yield f(x) < a, or more formally 



{x e dom f\f(x) < a} [38|. 
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The SCP approach works as follows. Given the auxiliary 
feasible rate vector z E T>, the L.H.S of each reverse-convex 
constraint gi(x) < is replaced by its convex majorant, which 
is the first order Taylor approximation around z, denoted by 
gi(x,z), as follows 



gi(z,x) = gi(z) +Wgi(z) T (x- z) 



ERis , 
log z s 
a. 



Q 



E 



Ris 



Algorithm 1. Sequential Convex Programming (SCP) Procedure 

Initialization. 

- Choose an arbitrary feasible vector a:' ' G ~D. 

- Establish problem P(x^). 

- Set k = 0. 

Main Loop. 

- At fcth iterate, obtain x^ k+1 ^ by solving P(£ (fc) ). 

- Set k «— k + 1 and repeat. 



Since gi(.) is differentiable, Vgi exists at auxiliary vector 
z e T>. It's easy to verify that gi(x,z) is affine in x and 
thereby gi(.) is convex. Thus, the constraint gi(x,z) < 
represents a convex constraint. 

Indeed, the intersection of L constraints gi(x,z) < 0,VI 
is contained in the nonconvex feasible region made by D.C. 
constraints, and thereby plays the role of an approximate to the 
nonconvex feasible region. Using the approximated feasible 
region, we obtain a convex problem that can provide arbitrarily 
good approximation to problem with D.C. constraints. Such a 
good approximate, however, essentially relies on the knowl- 
edge of a 'good' feasible vector z, i.e. a feasible vector such 
that the optimal point of the problem with D.C. constraints lies 
in the approximated feasible region. Such a vector might not 
be known a priori. Thus, we have to successively approximate 
the feasible region so as to obtain such a 'good' rate vector. 

To this end, we consider the following iterative setting 
(Algorithm 1). Let xr- ' be an arbitrary feasible point. Then, 
at the fcth iterate, we find 

x {k+1) e {z\z solves P(5 (fc) )}, 



where 



(18) 




max y w s U s (x s ) 
sex ~i 

subject to: 

E^(^ + ^# 

„ "« \ Xi 



Theorem 1: Suppose x^ e T>. Provided that transformed 
utility functions U s (x s ),s € S satisfy the conditions in 
Lemma 2| then for each k, the problem P(x^) defined by 
(fl~8[>-(|T9 1 is strictly convex and admits a unique maximizer. 

Proof: According to Lemma [2] provided that conditions 
C1-C3 hold for all sources, U s (x s ) is strictly concave. As the 



objective of problem (18i-(19i is a nonnegative and nonzero 
weighted sum of strictly concave functions, it is strictly 
concave too. 



Constraints ( 19 1 are affine functions and thereby are convex 
too. Therefore, we deduce that the optimization problem ( |T~8] >- 
( |T9] > is strictly convex [38) . Since the feasible set is compact, at 
least an optimal solution exists. Strict convexity of the problem 
guarantees that the optimal solution is unique. ■ 



We defer solving the optimization problem until the next 
section. 



V. Optimal Solution 
In this section, we derive an iterative solution to solve 



problem (18l-(19l 



A. Primal Optimality 

Let Lk(x,fi) be the Lagrangian associated to problem 
P(x [k} ) defined by tflil-tfli]). Then 



L k (x,fi) = ^2w s U s (x s ) -^2fngi(x,x {k) ) 



(20) 



where /i; is the positive Lagrange multiplier associated to 



approximated capacity constraint ( 19 1 for link I and fi = 
(fM, I £ C) is a vector of Lagrange multipliers. 

According to KKT theorem, the optimal solution of problem 
P(x^ k%> ) is the stationary point of the Lagrangian L k or 
equivalently its maximizer (38). As introduced in the previous 
section, x^ k+1 ^ solves P(x^ k> ). Hence, it is the maximizer of 
the corresponding Lagrangian, or more formally 

x^ k+1 \fi) — argmaxLfe(5, fi) 

Theorem 2: Given dual variable vector fi € Mrf , the 
unique maximizer of Lj~, i.e. ar fc+1 ^(/x) is given in ( bit , and 
Xs k+1 \n) belongs to I .<_h+i) where ii is the solution to 
the following inequality 

L .(fc+i) 

and 



(22) 



m s — E RisijLi 



(23) 



and L si (k+i) and U .o+i) are given in (24i and (25 i, respec- 
tively. 

Proof: See Appendix II. ■ 



Optimal source rates can be simply obtained from (21 1 by 
taking the inverse transformation of ( fl~4] > as follows 



(/*) 



-log^V) 



(27) 



where []x, is the projection operator onto X s . 



7 



00 



,4 



2u s (;< fc+1) 



+i) 



(fe) 



1 )\ Au . u s A .(fc+i) 



W -(fc+l) — U , .(fc + i) , , s 
Sl\ ' s\i s +1) 



(21) 



«B s a s AM s(i (Hi )+1) 

L S i <k+11 = 7 w f Y ^ 

A .(fc+i) ( G /.(fc+i) . + 1 ) ( u ,.(fc+D ,.<fc+i) + u .(fc+i) ) 
U S ii k+1) = 7 ~ Y ^ 

U (fc+l) 

where A ()t +i) = exp(a s /3 (k+u) and B (k+ i) = 5 exp(a s/ 3 (fc +i)). (26) 

SI " SIs Si " U.(k+i) +1 sts 



B. Dual Optimality 

Theorem [2] gives the optimal solution to the fcth problem 
P(x^ k ') as a function of Lagrange multiplier vector pt,. To 
obtain the optimal Lagrange multiplier vector, denoted by fi*, 



one has to solve dual problem associated to problem ( 18 1-( 19 1, 
which is given by (38 



D, 



mm 

pi>0 



h k {p) 



maxLfc(5, pi) 



(28) 



where hk(pi) is the dual function associated to problem 
P(5r fe ') and based on this terminology, pi is referred to as 
the vector of dual variables, too. 

In view of Theorem F21 the dual function can be expressed 
as hk(fJ-) = Lk (x^ k ~^(pi), pi). Solving dual problem in 
closed form is usually impossible. Instead, one can benefit 
from iterative methods to achieve the solution. Due to strict 



convexity of problem ( 18 i-( 19 1, dual function h^ip) is contin- 
uously differentiable over K^whose derivatives, by Danskin's 
Theorem, is characterized by [34]: 



dh k {pi) 
dpi 



Cl 



Ri 



log x 



~(ky 



*(*) 

Jy S 



(29) 



Due to differentiability of dual function, we solve dual prob- 



lem (28 I by gradient projection algorithm [34]. 

Let i/ ' = x^ denote the initial (primal) point to solve 
problem D^. Then, the dual variable update equation at tth 
iterate for solving is given in ( 30 1 in which 7^. is a suffi- 



ciently small constant step size properly chosen for problem 



Di. and \z 



+ _ 



max(z, 0). 



We defer the algorithmic description of this iterative proce- 
dure until the next section. 



A. Algorithm 2: The Two-Tier Algorithm 

The first rate control algorithm, listed as Algorithm 2, is a 
two-tier algorithm as it possesses two kinds of iteration: outer 
and inner iterations. The outer iteration corresponds to the 
iterations of SCP procedure (Algorithm 1). The inner iteration 
corresponds to the iterations required to solve the dual of each 
convex program at each outer iterate. 

Algorithm 2. SCP-Based Rate Control for SVC Streams 

A. Initialization: 

A.l. Choose an arbitrary feasible vector cc' ' 6 T>. 
A.2. Establish problem P(x^ ~>). 
A.3. Initialize thi and try. 

A. 4. Set k = 0. 

B. Main Loop (Outer Iteration): 

(fc + l) (k) 

Until max s \x s — x$ | < thi, at the fcth outer iterate do 

B. l. Establish problem P(i( fc )). 
B.2. Initialize 7^ and 

B.3. Set «(°) = x^ k \ 

B.4. Set t = 0. 

B.5. Inner Iteration: 

Until max s — Vg \ < trig, at the (thinner iterate do 



B.5.1. For each link I, update p^ using |30| 
B.5.2. For each source s, obtain fi 3 ^ = Ri B fi\ 
B.5.3. For each source s, find is*"*" 1 ' such that 
x{ k) L (t+1) < ft'W < x{ k) U (t+1) , 
where L (t+i) and U .(t+i) are calculated similar to |24|-j25| 



B.5.4. For each source s, calculate v, 

B.5.5. Let v* = i)( t+1 ). 

B.5.6. Set t ■f- t + 1 and repeat. 
B.6. Let = v*. 

B.7. Calculate a;( fc+1 ) using {27) . 
B.8. Set k <— k + 1 and repeat. 



(t+i) 



using 



VI. Rate Control Algorithms for SVC Streams 



Motivated by the iterative solution to problem ( 18 1-( 19 1 ob- 
tained above as well as SCP procedure outlined as Algorithm 
1, we propose two rate control algorithms for SVC streams. 



These algorithms are governed by optimal rate equations ( 2 1 
(|27]>, and (31 1, and optimal index inequalities (22i-(25l, and 



dual variable update equations (pOJl. 



The algorithm is initialized with a starting feasible vector 
£ (0) as well as thi and tti2 to check the stopping conditions 
for outer and inner iterations, respectiveljj^] Then, it proceeds 
as follows. At each outer iterate k, we establish problem 



Since both SCP procedure (Algorithm 1) and gradient projection algorithm 
are not finitely-convergent, one has to set a stopping criterion. 
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Mi 



(t+1) 



(*) 



lk- 



dpi 



(*) J 



E 



,(*) 



+ 



-(*)' 



~(fc) 
Is 



(30) 



P(x ( - k) ) defined in (18i-(19i. The output of the fcth outer 
iterate is the unique maximizer of problem P(x^ k '), which is 
denoted by 5 (fe+1) . At the fcth outer iterate, problem P(a; (fc) ) 
will be solved through its dual Dj.. As in previous subsections 
we employed gradient projection algorithm to iteratively solve 
Dfc, inside the fcth outer iterate, we will have an iterative 
procedure (inner iteration). In this respect, in the fth inner 
iterate, we will update dual variable using (|30|l. 



B. Algorithm 3: Simplified Algorithm 

In order to tailor the two-tier algorithm proposed in the pre- 
vious subsection as Algorithm 2, here we present a simplified 
and efficient variant of that. Such a simplified variant relies on 
just the outer iteration: Indeed, instead of solving the problem 
P(5r') in the fcth outer iterate through many iterations to 
obtain the optimal dual variable vector accurately, we just 
solve it with one iteration to obtain an approximate value of 
optimal dual variable vector. This is similar to choosing a 
quite large value of th.2 in Algorithm 2, such that after just 
one iteration, the stopping criterion will be satisfied. 

Note that at the fcth outer iterate, we solve P(xS k ') using 
dual method to obtain ScS k+1 \ Then, this will be employed 
to establish P(ar fe+1 ^). Now let xr k+1 ' be an approximate to 
x^ k+1 \ Then, one would come up with problem P(x^ k+1 ') 
instead of P(5^ fc+1 - 1 ). As both the aforementioned prob- 
lems strive to approximate the original D.C. problem, in the 
worst case, P(x^ k+1 ') will yield a worse approximation than 
P(x^ k+1 '), and the convergence guarantee will not be violated 
at all. The corresponding algorithm is listed as Algorithm 3. 
Although the convergence speed of Algorithm 3 might be 
slower than that of Algorithm 2, the former lends itself better 
for distributed implementation as it only has the outer iteration. 



C. Message Passing Mechanisms 

The developed algorithms thus far mentioned require some 
form of message passing at each iterate. The first message 
passing is required for communicating the updated dual vari- 
ables to the corresponding sources, and the second one is 
required for communicating the calculated source rates to the 
links on the corresponding paths. The first message passing is 
to be implemented by explicit message passing inspired by the 
work 1 40 1, with messages containing updated dual variables 
for source rate calculations in the next iterate. 

In most previous studies, the second message passing have 
been accomplished implicitly by measuring the flow of link 
I. In our case, however, dual variable update is done using 
transformed domain rates x s , s € S, and as dual variable 
update points out, the update cannot be accomplished by mea- 
suring the flow of links. Therefore, explicit message passing 
is required. 



Algorithm 3. Distributed Rate Control for SVC Streams 

A. Initialization: 

A.l. Choose two arbitrary feasible vectors 
A.2. Choose a Lagrange multiplier vector /nW. 
A.3. Initialize 7 and th. 
A.4. Set k = 1. 



B. Main Loop: 



Until max s \x 



(fc+l) 



(fc) 



I < th, at the fcth iterate do 



(k) 

B.l. For each link (, update fi^ using 



(k) 



7 { Cl - T.s 



log X 

{k) 



0-1) , X. 



4 fc - 1) J) 



B.2. Obtain fi s< - k ) = "£i RlsM ■ 

B.3. For each source s, find is fe+1 ' such that 

x ( s k) L . (fc+1) < M s(fc) < xi k) U , (fc+1) , 

where L and U .(fc+i) are calculated by d24|-j25| 

s s (fc+l) J 1^ — 

B.4. For each source s, calculate i usins d211 and 1271. 

B.5. Set k <— k + 1 and repeat. 



D. Convergence 

We conclude this section by a result on the convergence of 
the proposed algorithms. 

Theorem 3: If step sizes in Algorithm 2 are chosen suf- 
ficiently small, then starting from any feasible vector x^°\ 
Algorithm 2 converges to locally optimal points of problem 

Proof: (Sketch) The proof of this theorem is quite similar 
to the proof of Theorem 1 of |39) , and we omit the details 
here due to space limit. 



To prove the assertions of theorem, similar to 1 39 1, one must 
show that the sequence {x^} is feasible and also converges 
to a KKT point. It can be shown that if x^ is chosen to be 
feasible, provided that step sizes are chosen to be sufficiently 
small, then ar fe %Vfc will remain feasible. The next step is to 
show that {x^} is a nondecreasing upper-bounded sequence 
and thereby it will converge asymptotically. 

■ 

Remark: Note that tb.2 has no effect on the convergence 
guarantee of Algorithm 2 as for sufficiently small step size, 
all primal values within the inner iteration remain feasible. 
Therefore, the above result will be applicable to Algorithm 3, 
as well. 

VII. Simulation Experiments 

In this section, we evaluate the performance of Algorithm 
3 for SVC streams through extensive simulation experiments. 
First, we introduce SVC transmission scenarios that will be 
used in our experiments. It is followed by three simulation 
scenarios. 



A. Simulation Setup for SVC 

In order to achieve realistic simulation results, we adopt 
testing conditions for SVC standard provided in [41]. We have 
used four different video sequences: Football, Foreman, Bus, 
and Mobile |42) to take into account the requirements of a 
broad range of video applications. These sequences can be 
transmitted in different settings, each one having specific fea- 
tures such as number of spatial, temporal, and quality layers. 
Table [I] summarizes the required bit rate for transmission of 
each video sequence with different settings in terms of the 
number of spatial, temporal, and quality layers. 

TABLE I 

Tested Bit Rates for the Quality and Spatial Scalability Test 



Sequence 


Format 


Bit Rates (Kbps) 


Bus 


QCIF 15 Hz 


96 


128 


192 


CIF 30 Hz 


384 


512 


768 


Football 


QCIF 15 Hz 
CIF 30 Hz 


192 

768 


256 
1024 


384 
1536 


Foreman 


QCIF 15 Hz 
CIF 30 Hz 


48 
192 


64 
256 


96 
384 


Mobile 


QCIF 15 Hz 
CIF 30 Hz 


64 
256 


96 
384 


128 
512 



B. Scenario 1 

For the first scenario, we consider a simple scenario, in 
which 12 SVC-encoded video streams share a bottleneck link 
with capacity c = 5 Mbps. Video Sequences and weights 
of all sessions are listed in Table [TTJ All sources have the 
same parameter a — 2. For the sake of illustration, we let 
all sources have utility functions with the same quality index 
sequence {u s i},s — 1, . . . , 12. However, their rate index 
sequences {f3 si }, s = 1, . . . , 12 are determined based on the 
video sequence (Table [I]). We choose the following quality 
index sequence 

{u si } = {0, 2, 2.8, 3.4, 3.9, 4.3}; s = 1, . . . , 12 

It's easy to verify that {it s j}i=o,...,5 is a monotonically increas- 
ing and strictly concave sequence and G S i 1 and therefore 
the conditions of Lemma [2] are satisfied. 

The rate allocation is carried out using Algorithm 3 with 
step size parameter 7 = 10~ 2 . The allocated rates obtained 
from Algorithm 3 for video sessions are summarized in Table 
[H] Fig. 2(a) and 2(b) depict the evolution of source rates and 
the dual variable, respectively, as the transient behavior of 
the algorithm. Assessment of such a transient behavior gives 
insights into how much fast the algorithm converges toward 
global optimality. Both figures reveal that the convergence is 
quite fast and about 200 iteration steps are needed to reach 
the steady state. 
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(b) Evolution of Dual Variable 
2. Simulation Results for Scenario 1 



C. Scenario 2: The Effect of Quality Indices 

In this scenario we study the impact of different quality 
indices on rate allocation to account for existence of different 
preferences amongst users. Towards this, we consider a topol- 
ogy in which 3 sources share a bottleneck link with capacity 
c = 2 Mbps. Then, we associate Football sequence with the 



TABLE II 
Rate Allocation for Scenario 1 



Source 


Video Sequence 


w s 


x B (Kbps) 


i* 


1,2,3 


Bus 


2 


432 


4 


4,5,6 


Foreman 


0.75 


192 


3 


7,8,9 


Football 


2 


816 


4 


10, 11, 12 


Mobile 


1.5 


224 


3 



10 



It IS 

has 



same weight parameters to all sources, with different quality 
index sequences listed as follows 

{u u } = {0,2,3.9,5.7, 7.4,9,10.5} 

{u 2i } = {0,1,1.9,2.7,3.5,4.2,4.8} 

{u 3t } = {0, 0.5, 0.95, 1.35, 1.7, 1.95, 2.15} 

It is straightforward to show these sequences are monoton- 
ically increasing and strictly concave and G S i ^ 1. For 
the sake of illustration, the multimodal sigmoid approximated 
utility functions corresponding to these video sessions with 
abovementioned quality indices are depicted in Fig. 3(a) The 
value of a for all sources is set to 3 and step size is chosen 
to be 7 = 10~ 2 . The allocated rates obtained from Algorithm 
3 for video sessions are summarized in Table [III] 

Fig. 3(b) and 3(c) display the evolution of source rates 
and dual variable, respectively. Focusing on Fig. 3(b) 
clear that the first video source whose utility function 
the most rapidly increasing envelope, achieves more rate than 
other sources. This fact is consistent with NUM formulation, 
where the optimization problem allocates available bandwidth 
so that utility functions with higher increases attain larger rates 
in order to maximize the total utility as much as possible. 
However, this is in contrast to rate allocation for SVC streams 
with utility-proportional rate allocation J26) , in which rate 
allocation is carried out in favor of sources with utility 
functions having slowly increasing envelope. 

D. Scenario 3: The Multiple Link Topology 

For the third scenario, we focus on a network whose 
topology has several bottleneck links. The network has 8 video 
sessions traversing 12 links and whose topology along with 
paths of video sessions is depicted in Fig. |4(a)| in which for 
the sake of brevity, only links with more than one video session 
are depicted. The capacity of all links is set to 1 Mbps. For 
all video sessions, we choose a = 5 and the quality index 
sequence as follows 



{u si } = {0,2,2.8,3.4,3.9,4.3}, 



1, 



The results of rate allocation for this scenario with 7 = 
10 -2 is summarized in Table IV In order to investigate the 
convergence behavior of this scenario, the evolution of session 



rates is depicted in Fig. 4(b) This figure demonstrates that 
similar to Scenario 1 and Scenario 2 (with single bottleneck 
link), convergence is relatively fast. The evolution of dual 



variables is shown in Fig. 4(c) As this figure presents, some 



links have non-zero dual variables that implies the saturation 
of such links. 
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TABLE III 
Rate Allocation for Scenario 2 



Source 


Video Sequence 


Ws 


x s (Kbps) 


A* 
l S 


1 


Football 


1 


828 


4 


2 


Football 


1 


614 


3 


3 


Football 


1 


558 


3 



VIII. Conclusion 

In this paper we addressed rate allocation for scalable video 
streaming applications via Network Utility Maximization 
(NUM) framework. To take the advantage of current develop- 
ments in NUM problems, we first remedied nonsmoothness of 
the NUM for such applications by exploiting arbitrarily tight 
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TABLE IV 
Rate Allocation for Scenario 3 



Source 


Video Seq. 


w s 


x B (Kbps) 




1,2,3,4 


Mobile 


1 


281 


4 


5,6 


Bus 


2 


409 


4 


7,8 


Football 


2 


840 


4 



sigmoid-based approximations of the ideal discretely adaptive 
utility functions. We then presented a nonconvex D.C. problem 
whose solution is shown to be the solution of an approximation 
of the smoothed NUM. The presented D.C. problem comprised 
strictly concave objective and D.C. constraints. We established 
the concavity of the objective of such a D.C. problem based 
on some mild conditions on the quality indices as the utility 
function parameters. As such, by employing Sequential Con- 
vex Programming (SCP) approach, we replaced the problem 
with a sequence of strictly convex programs. Taking the 
benefit of SCP approach for the noncoonvex D.C. problem, 
we devised two iterative distributed algorithms, for which 
convergence to a KKT point of the nonconvex D.C. problem is 
guaranteed under mild conditions. The algorithms were based 
on solving the dual of convex programs generated by SCP 
approach using gradient projection algorithm. As such, the two 
algorithms lend themselves to distributed implementation with 
low message passing overhead. Our experimental results have 
shown that the proposed algorithms have tractable convergence 
properties. A promising future direction to our development 
is to consider jointly optimal rate control and scheduling for 
scalable video streaming over multihop wireless networks. 
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Appendix I: Proof of Lemma 1 

Since U is not guaranteed to be twice differentiable, we can- 
not use its second derivative to establish concavity conditions. 
However, as Gj 3> 1, i = 1, . . . , N results in differentiability 
of U, we use the first order strict concavity criterion to derive 
the conditions under which U is strictly concave. In other 
words, we seek conditions under which U'(z) is monotonically 
decreasing. Considering (15 1, U' for z £ int % is given by 



d ( Au i+1 z 
log ( — ; — — + u 



dz 



z + e 



a0i 



z + e a A) (Au i+ iz + UiZ + Uie a P*) 
(u l+ i - Ui)Ai 



z + Ai) (u i+ iz + UiAi) 

Uj + l—Uj ^ 
U i+ 1 1 



•Ai)(z- 
A, - B, 



v-i+l 



-A, 



z + Ai)(z + Bi) 



(34) 



In order to obtain decreasing monotonicity conditions, for i = 
0, . . . , N — 1 we require 



Vzi,z 2 e int %,zi <z 2 ^ U'(zi) > U'{z 2 ) 



and 



Vzi £ li , Vz 2 £ T. 



j>i 



U'{zi) > U'(z 2 ) 



(35) 



(36) 



First we concentrate on (35 1. Over int Ti, U'{z) is differen- 
able with the derivat 

U"{z) = (Bi - Ai) 



tiable with the derivative given by 

2z + A, + B 



(z + Ai) 2 (z + Bi) 2 ' 



z e int li (37) 



As li C R+, we have z > and hence U' is monotonically 
decreasing over int % if and only if 



B t < At 



Ui < u i+1 



which is equivalent to saying that {ui}i=o,...,7v is a monotoni- 
cally increasing sequence. Fortunately, this condition is always 
satisfied as a higher laye r has a higher quality index. 

Now we focus on (36i. Since U' is monotonically decreas- 
ing over int %, it suffices to satisfy (36i for j = i + 1, i.e. 
for z\ £ % and z 2 £ li+i- We characterize z\ and z 2 as 
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lim U'(z) > lim U'(z) 
Ai - B l 
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A: 1 



/If 
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(33) 



having respectively ei > and e 2 > distance to the joint 
boundary of % and Zj+i, i.e. z\ — e Q (ft+ A ft+i/ 2 ) — £l and 

Z 2 = e a(/3»+Aft +1 /2) + £2 Then ^ must ho j d for some 

ei,e 2 > 0. Recalling e «(A+Aft+i/iT= calculating 
([36]> as ei and e 2 approach 0, yields (32i. On the other hand, 



.4 



e aft e a(ft +1 -ft) 



AiG^ +1 



Substituting this into (32 1 yields (33i. Then, for G^+i ^> 1, 
we get 

2 



H+l 



> 



or equivalently, — Ui > u i+2 — which tells us that 
{ui}i=o....,N is a strictly concave sequence and completes the 
proof. 

Appendix II: Proof of Theorem 2 

Due to strict convexity of the problem, Lagrangian maxi- 
mization has a unique solution, for /j, fixed. According to KKT 
condition, the unique maximizer to Lagrangian maximization 
(20 1 is the stationary point of Lf.(x, [/,), i.e. the point at 
which VLfe(5jjx) vanishes p4| . In order to find the stationary 
jg( fc + 1 ) ) using (34 1, we find the derivative of Lk(x, A) and then 
solve VL t (x (W) ,/i) = as follows 
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manipulation on (38i, ^ k = is rewritten as 
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where i s ' is the index of interval within which xl ' falls. 
For the sake of brevity in our derivations, we let y — x« fc+1 ^ 
is + . Then, using these new variables (39i is 



and j 
rewritten as 
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whose solution is given below. 
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where /i s = Optimal transformed rate of source s, 

0. By some algebraic 
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For equation (40 1, simple algebraic manipulations yields 
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which after substituting y and j respectively by xi k and i s k+1 \ completes the proof. 
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